Audio-driven Nonlinear Video Diffusion

Speech-driven facial animation using a hierarchical model - Vision, Image and Signal Processing, IEE Proceedings-

A system capable of producing near video-realistic animation of a speaker given only speech inputs is presented. The audio input is a continuous speech signal, requires no phonetic labelling and is speaker-independent. The system requires only a short video training corpus of a subject speaking a list of viseme-targeted words in order to achieve convincing realistic facial synthesis. The system...

Short-term and Long-term Impact of Video-driven Metapragmatic Awareness Raising on Speech Act Production: A Case of Iranian Interme-diate EFL Learners

Pragmatic comprehension of apology, request and refusal: An investigation on the effect of consciousness-raising video-driven prompts

Recent  research  in  interlanguage  pragmatics  (ILP)  has  substantiated  that  some  aspects  of pragmatics are amenable to instruction in the second or foreign language classroom. However, there  are  still  controversies  over  the  most  conducive  teaching  approaches  and  the  required materials.  Therefore,  this  study  aims  to  investigate  the  relative  effectiveness  of  conscio...

Denoising of Audio Data by Nonlinear Diffusion

Nonlinear diffusion has long proven its capability for discontinuity-preserving removal of noise in image processing. We investigate the possibility to employ diffusion ideas for the denoising of audio signals. An important difference between image and audio signals is which parts of the signal are considered as useful information and noise. While small-scale oscillations in visual images are n...

Audiovisual Attention Modeling and Salient Event Detection

Although human perception appears to be automatic and unconscious, complex sensory mechanisms exist that form the preattentive component of understanding and lead to awareness. Considerable research has been carried out into these preattentive mechanisms and computational models have been developed for similar problems in the fields of computer vision and speech analysis. The focus here is to e...